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THE  SOLUTION  BY  ITERATION  OF  NONLINEAR  INTEGRAL  EQUATIONS 


ABSTRACT 


In  the  mathematical  formulation  of  many  physical  problems  there  are  fre- 
quently encountered  integral  equations  of  the  linear  as  well  as  non-linear 
type.  The  adequate  solution  of  such  equations  then  becomes  a practical 
necessity. 

It  turns  out  that  for  large  classes  of  non-iinear  integral  equations 
describing  certain  wave  phenomena  the  well  known  method  of  successive  approxi- 
mations provides  a feasible  means  of  constructing  a solution,  securing  its 
uniqueness,  and,  in  the  process,  furnishing  practical  estimates  of  relevant 
magnitudes  and  errors.  Furthermore,  the  method  also  lends  itself  quite  easily 
to  treatment  on  high  speed  computing  machinery. 

These  principal  conclusions  are  illustrated  - and  borne  out  - by  means  of 
an  appropriately  chosen  example. 


1.  INTRODUCTION 


It  is  A well  known  fact  that  many  physical  problems  lead  te  nonlinear  integral 
equations.  The  folic wing  examples  serve  to  illustrate  this  point* 

i.  Nyatrom  has  shown  flj  that  the  general  first  boundary  value  problem  in  the 
theory  of  ordinary  differential  equations  may  be  reduced  to  an  ordinary  differential 
equation  of  the  type 

y - F (x,y)  -1/2  * x k 1/2 

with  the  boundary  conditions  y(-l/2)  » y(l/2)  - 0.  This  equation,  in  turn,  is 
equivalent  to  the  integral  equation 


yr 

y (x)  - J K (x , a } F (s,y(s))  ds, 

-1/2 

KM  representing  the  Green’3  function  ?.r  the  boundary  value  problem, 
li.  Boundary  value  problems  of  the  form 

+ u41  ■ exp  u 

"*  /j 

with  u * f (x,^  ) on  the  boundary  C of  the  given  region  B,  are  reducible  to  integral 
equations,  as  follows  ry.  Let  w(x,  f ) be  the  solution  of  the  boundary  value 
problem 


jv»0j  w**fonC. 

Then  the  function  y - u-w  clearly  satisfies 

/Jy-y  exp  w - [exp  (y)-yj  exp  w 

with  y ■ 0 on  C*  If  now  K(x,  £ j s,o)  £ 0 denotes  the  green's  function  of  the  problem 

4 y-y  exp  w ■ 0,  y - 0 on  C, 
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then  it  may  be  sho'-n  that,  y(x,  £ ) i3  a solution  of  the  nonlinear  integral  equation 

v(y.  £ i 4-  /T  K fv  . > • <5.0^  fl-VI  (ir}  —irT  »vn  (l-T ) '1  sd-^  = 0 * 

iii.  In  the  discussion  of  certain  wave  phenomena  L.  Lichtenstein  £3j  was  led 
;,o  the  3tudy  of  integral  equations  of  the  form 

••  b b 

L y (x)  - X / r (sJs^...si)3(s^"y(si)  ds^...dsi  * 0, 


with  L denoting  a linear  operator,  and  the  symmetric  and  continuous  functions 
in  the  (n+l)  dimensional  unit  cube. 

Physical  situations  leading  to  similar  nonlinear  integral  equations  have  also 
be.' a described  bv  Sohmeidler  f)i  7 - 

" V J 

The  solution  of  such  integral  equations  may  be  accomplished  in  general  by  a 
variety  of  methods,  with  the  choice  of  the  most  appropriate  one  naturally  depending 
upon  the  form  and  type  of  the  integral  equations  of  interest.  Such  methods  may 
emply  closed  analytical  expressions,  power  series  expansions,  the  replacement  of 
integrations  by  summations,  successive  approximations,  variational  methods,  etc.  [*J- 

The  approach  to  be  vised  here  will  be  the  iterative  one,  to  be  applied  to 


integral  equations  of  a generalised  Lichtenstein  type: 
r b b 

y(x)  - ^ C...  j"  Ki(x,s1,...si)F1(s1,...si)  yU1)...y(si)'ds1...dsi  » 0. 

i«l  a a 

Integral  equations  containing  an  '’inhomogeneous"  term,  e.g.,  of  the  form 

y*  (x)  - K0  (x)  -J'K1F*(yW)  = 0 

can  obviously  be  reduced  to  the  form  (l)  by  the  substitution- 

y - y - V 

For  kernels  whose  squares  are  integrable,  and  functions  F^  that  have  bounded 
derivatives  the  existence  and  uniqueness  of  a solution  will  be  proved,  and  an 


(1) 


upper  bound  for  max  |y|  will  be  given.  The  proof  is  based  on  the  method  of  successive 

iterations,  a method  which  also  easily  provides  an  estimate  of  the  error  inherent  in 
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the  nth  approx inr.t ion.  l’he  results  will.  then  be  generalized  to  373 terns  of  equations 
of  type  (l),  and,  finally,  an  example  ’.dll  be  given. 

9.  ASSUMPTIONS  AND  NOTATIONS. 


For  the  sake  of  simplicity,  we  shall  take  r = 2 in  eq.  (l),  i-.e.  consider  in 
the  intei'val  Is  a ^ x,3,t  £ b the  equation, 

y(x)-  f IC^Xjs)  F-,  's,y(s))ds  -|TK2(x,s,t)F2(s,t,y(b,  y(t))dsdt  - 0.  (2) 

The  kernels  and  Kg  will  bo  assumed  to  have  integrable  squares,  so  that  Sh<**  )ds, 
jjK2^(x,s,t)ds  dt  exist  and  are  continuous  functions  of  x £l.  For  the  maximum  of 
a continuous  function  f (s)  def:med  in  I vs  shall  employ  the  notation 

II  f I - max  |f  6c)/  . 


Then 

r - Hfiq  d s + JjK^  ds  dt  | certaihly  exists. 

The  continuous  functions  F_(s.u).  F- (s,t,u,v),  defined  for  5,  t € I,  u,v  0 , 

where  J denotes  a certain  interval  ^*c,c } , are  assumed  to  satisfy  conditions  of  Jxe 
form 

/F1(s,u1  ) - 1^  - u,  { (3) 


/ F2(s,t,Ui,Vi)  - F2(s,t,u2v2)|£  L2(  lu^-Ugl  +K  - vg0  f 
where  L_,  L2  are  positive  numbers  independent  of  s,  t,  u,  v.  The  quantities 

Mj2  ■ llFi2(3,0)f|  * Mg2  *•  |{F22(s,  t,  0,  0)  ji 

then  also  exist. 

Relations  (3)  certainly  hold  if,  for  example,  Fj  and  F0  have  continuous  partiSL 
derivatives,  SF,/8u,  BFg/ou,  oFg/'dv  for  arguments  restricted,  respectively?to  the 
internals  I,  J. 
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Further,  we  out 

^ • b - a,  a » 1 or  2 for  A £ / or  A >1  , 

Other  quantities  to  be  employed  later  on  are 

o 2 2 2 2 2 

L"  - Lx  + I<2  , M * Mj_  + M2  . 

A*1  KK  - E,  A®  KL  « B. 

In  the  following  extensive  use  will  be  made  of  Schwarz's  inequality 

/J’f(x)g(x)dx|  h.  ( J*f 2 dx)1/2  ( J"g2dx)1//2.  (U) 

Thi3  relation  is  applicable  also  to  multiple  integrals  and  sums.  If  wo  put 

iff  I m.  I2^2)' 

then  eq.  (U)  may  be  expressed  in  the  form 

iV/y/2)  ± Kf)x(g).  {$) 

3.  LEMMA. 

We  are  now  in  a position  to  sw.o  the  following  Lemma: 

Let  y €J  be  a solution  of  Eq.  (2),  and  let  the  satisfy  conditions  of  type 

(3).  Then  #y  | (l  - 2D)  jfeE, . 

Proof.  It  follows  from  eq.  i2)  that 

4 tfrw- 

In  thi3  inequality  the  right  side  is,by  (3),  identically  in  x, 

' t Kiy  I (F1)  ♦ I (Kg)  1 (F2). 

From  Schwarz's  inequality  for  sums  it  may  now  be  deduced  that 
fyfd  [l2(\j  * l"(K2)J  1/yi2(F1)  4 I2  (F2)J  1/2 


! '1/1 

1 » 

r* 


£ K [l2 (F1)  + I2(F2)J  1/2 * 


Since,  by  assumption,  y <•.  J,  we  may  make  use  of  relationships  (3),  getting 
I2(F2)  *^£/y3,t,o,0}{  4 Lg (ly(s)l  + /y  (t)j  )J  2 dsdt 

~ a2o(^2  + 2 l2  11  y k )2' 


1* 


i 


3i  't'ilr  riy. 


I2  (r  1)  k +■  2 L1  //  y fl  ) ' . 


2y  addition,  then. 


I2  (F1)  + 1 2ii2)£  A2u(K  + 2L  II  yB  f. 


fly  Ilk  K A°(K  + 2L*y J ) * E + , 

which  rirov"®  the  lemma. 

ll,  EXISTENCE  THEOREM . For  functions  F^,  F^  satisfying  conditions  (3)  with 

0 * E/(l  - 2D)  k O (63 

eq.  (2)  has  exactly  one  solution. 

To  prove  this  theorem  >Te  U3C  successive  iteration,  starting  with  arbitrary  con- 
tinuous function  yQ  £ J,  and  defining  a sequence  { yn  ^ of  continuous  functions  by 

yn+iva)  -jit,  (x,s)  F^(s,yn(s))  ds  + J^/\>(x>3,t}F2  (s,t,yn(s),  * (?) 

yn(t)  ds  dt,  n « 0,1,2... 

First  we  show  by  induction  that  y € J.  Let,  then,  y have  this  property. 
By  definition  (7),  following  the  same  reasoning  that  was  used  to  prove  the  lemma^ 
there  is1  obtained. 

II  yj  £ E ♦ ZD  Jly^f. 

From  the  inductive  assumption  and  condition  (6)  it  may  now  be  inferred  that 

fly  i|*E  + 2D C'k  Ci 

i.e.  y € J. 

•'n 

Next,  the  sequence  is  easily  shorn  to  be.  uniformly  convergent,  as  follows: 


i W^n  i 4 0Kl!Fl(yn)  - ,l(5'n-l»  ds  < 

* /jjK2(F2^n)-F2(yn_i))  d=  dt  ( 
it  follows , by  means  of  Schwarz's  inequality,  that 


i 


iyn+l":V.f~  *'  f 1 ":a-l ' ' * 1 UoC’.; 

Taking  advantage  of  rcl-ti*>ns  (3)  tV  » i.  j.t  tl.  \ ‘ -v.\ 

-2  /|yn-;Vl», 


so  x,nax. 


* 


m 


or,  by  induction, 

II  y , " yn  A * 0 yl  ’ yo  * (2D^  n ^ °* 

n+1  ° 

30 

Since  1 - 2D>0  (2D)  is  convergent,  and  it  follows  that  the  partial  suns 

n=»o 

CD 

y of  y + (y  - y are  absolutely  and  uniformly  convergent. 

p h*tL  n 

The  continuous  limit  function  y of  the  f Yn  j is  easily  shown  to  be  a solution 
of  eq.  (2).  Putting 

Jk^FAj)  ds  + Jf*2F2^  ds  dt  = 
we  find^namely,  that 

|yn,l  - y*U  K ['x2CF1(yii>  - FjW)  * I2(F2(yn)  - Fjly))} 

But  the  continuity  of  the  in  conjunction  with  the  uniform  convergence  of  y^ 

towards  y suffice  to  make  the  difference,  ^(y^)  - F^(y)  arbitrarily  small  by 

& 

taking  n sufficiently  large.  Thus  also  lim  yn  - y uniformly  in  x.  It  follows 
that  y*  * y,  i.e.  that  y is  a solution  of  eq.  (2). 


Finally  , to  show  that  y is  the  only  solution  of  eq.  (2)  under  the  conditions 
Stated  «LuO*  re  let  it  be  assumed  that  there  exists  another  solution  Y(:;),  Clearly 

tr-rUton.!-?*  ♦»yn*a-y#. 
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♦ and  Jj  3rn4-1  -y|*  -c/2  for  The  reasoning  applied  above  to  establish  the 

relationship  (o)  no-?  lends  to 

U yn+i  - YB£(2D)Ufy  - Y H , 

h 

or 

H7a.i-v**(0»nHyo-*l> 

whence 

If  yn+1  •-  * £ -C  * /2  forn>N2. 

Consequently 

K y - y II  < c . 

» Due  to  the  arbitrariness  ‘ of  f and  the  meaning  of  fY  - y/Jfit  i3  then  necessary 

that  I(x)  - y(x)  * 0. 
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By  the  lemma, which  isr  applicable  here,  and  by  condition  (6), 


If  yll  * E/(l  - 2D)  £ 

For  increasing  values  of  K,  L,  M,  thereforp,the  upper  bound 
Ei/(  1 - 2D)  of  Jy  false  inci'eases. 

An  estimate  of  the  error  H y - y^jj  of  the  n*’*1  approximation  is 

easily  obtained.  From 


//  r - ynu«y„*i-V  * “ y ‘ Vi" 


it  follows  that 


n+m 


i-n 

For  fixed  n.  then,  since  y -^y  uniformly, 


//  y “ yn  f ^ X it  7±  - - y±  // 

n i-n  1 x 1 


n-1 

2 

i**o 


■ 1 *yi»l  - yn  J?' 


system 


l|  7 - yn/|^//y i - yj  (2D)n/((i  - 2d)  for  n^o.  (9) 

p.  GENERALIZATIONS . 

Equation  (2)  may  be  considered  to  be  a special  case  of  a more  general 


y(x)  ->  */•  sj^Fi^si,,*,Bj,yi(v,*,,3ri(s^,,',*yp^8i)»,,,» 

j i 


yp(s^)ds1...ds;j  - 0, 

where  i - 1,2,...,  p,  p 8-1,  q ?1,  To  such  systems  the  results  of  the 
previous  sections  may  be  transferred  without  difficulty;  it  is  necessary 
only  to  replace  the  quantities  o,  E,  D II  y l( , etc.  by 
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a = 1 or  q for  A £1  or  A > 1, 


f 1 iVi,)  s - Kt?, 


Z H13l  - M,2,  *«  f Vl  - E"  A“  fKlLl*D‘ 

A 

II  y it  - •!  ^ y^x)  S * 


Finally,  the  important  subsidiary  condition  1 - 2D  > 0 must  be  replaced  by  1 -OD  >0* 
For  p ■ q » 1,  i.e.,  for  the  equation 

y(x)  - J^K(x,s)  f (s»y(s))  ds  «0,  (10) 

this  condition  1 - qO  > 0 becomes  0 ^AXL  *■  1,  or 

oca2k-l2  -i  .1.  (11) 

i 

Let  us  ascertain  its  meaning  for  the  casts  of  the  linear  integral  equation 
of  the  second  kind 

y(x)  - Xj  K (x,s)  y(s)  d*  - x (x).  (12) 

This  type  of  equation  is  obtained  from  eq«  (10)  by  putting 
F(s,u)  - g(s)  + X u 

f(x)  •Jk{x,b)  g (s)  ds. 

Since  in  this  case  L » II  SF/du  II  « /X  l » ineaualitv  (111  indie* tea  that 

•»  * r ir  * ® ' ' 

XV/  lVk2  4 1. 

Now  for  the  characteristic  value  of  smallest  absolute  amount  of  the 
symmetric  kernel  there  exists  the  relation  [6 J 

V * < jJT • 

Consequently,  condition  (11)  becomes 


I X/  -c  1^1, 

which  is  the  well-known  sufficient  condition  for  the  existence  of  a unique 
solution  of  eq»  (12)  for  arbitrary 
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6*  APPLICATIONS • 


There  are  many  practical  cases  where  the  kernels  may  be  expressed  in 

bilinear  forms 

K-^XjS)  m (x'7'li  's'  (U) 

X2(X„ 8,t)  - £ <p2i  (x)  (s,t)  . 

the  . being  linearly  independent  of  the  0_ . . and  the  summation  to  be  extended 
XI  ^3 

over  a finite  or  infinite  nunber  of  values  i,  In  such  cases  the  iterative 
procedure  (?)  clearly  becomes 


Vi,i  *p2]  M Vi,j  '<1W 

»»l,i  ■ ff  ll<e)  P1  (a*  Z*uS3>1‘*.  * 2%J<S>  V* 

Sm-I.J  “ If  ft i 1'2<”*t>  \ (•)  ♦ j'  (•)'«  dt. 

The  iterative  procedure  lor  the  functions  yn(x)  is  thua  reduced  to  a method 
of  successive  approximation  for  the  constants  p^,  q^s 

7* 

Vl,i  ■ ^l^pni»  (1$) 


'hwl 


In  the  limit,  then. 


■ <5  ft)  a n V 

,j  ^J^ni*  "nj; 


7W  - % $1!  (*>  P±  ♦ (x)  Qj  , 

where  the  satisfy  the  functional  equations 

* & (?••  O 


(16) 


pi 


A -1-  rV 


for  all  i,  j. 


qS  “ ^2  (pi»  V 


(17) 
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Whenever  the  functional  equations  (1Y)  art-  directly  solvable  the 
solution  (16)  may  be  obtained  iT-mediatcly.  Otherwise  U3e  must  be  made  of 
the  successive  approximations  (15) « 

Let  us  now  apply  the  foregoing  deductions  to  the  following  oases 
^(x.s)  « x(l-s),  Is  <o,  1> 


K2(x,s,t)  - exp(x-s-t) 
F1(s,u)  - X(u+1) 
F2(s,t,u#v)  - X u v. 


J:  <-l,  1> 


The  equation  to  be  solved,  than,  i3  ^ 
y(x)  -X  / /'x(l-s)  [ y(s)*l  ] da  * jjk* ep(x-s-t)y(s)y(t)dsdtj  ■ 0. 

^ <L  U«.  OOW— %» M MA  ^ V\A  4 ^ A%*e  4"  4 WA  VS  Tl  l~l  l~>  l~l  ll  I 11«  »?4  Cl  A*«  (IA  A/l  A V\  ATTA  4 4 4 M 

uiiC  wvityo*  (cuvo  v/x  wii<d  ^vcA«uj.f  c ^4vvDuiM.o  wu,uwuogcu  «ww»o  V X o 


sufficient  that 


Hew 


0 ^ E/(1-2D)-*1« 


L « 2 


2 

9 

I A 1 , 


1/2 


K - ['(1/3)  ♦ (e2  - 1)2A«V 

,1/2 


1.31 


M - / X / . 


(6) 


(16) 


Condition  (6)  is  satisfied,  then,  for 


-1 


I XI  *■  Xo  * £k  (1  + 2 /2)J  * 0.2  (19) 

further,  the  lemma  indicates  that  for  the  solution  y(x), 

ii  fmm\  is  j v » 1 i // i * \ a i/rt  J » 

//  /U /«=  a # ai  ^ I /V  | / c f • 

Since  in  this  example  i « J ■ 1,  the  iterative  process  for  eq.  (10)  may  be 
expressed  in  the  fora 

Wx)  ■ X ("n.!1  * Vl  “P  (X>J> 
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with 


/>  0m  — | 

Pn+i  - J (1-s)  LX^PnS+qn  eX?  (s"  + V d£? 

/t 

2 r ~i  2 

qn+l  3 X L J (pnS  exp(“3'  + qn'  ds J * 

e 

According  to  the  existence  and  uniqueness  theorem  p - lira  p_, 
q • lira  exist.'  These  limits  satisfy  a system  of  equations  corresponding 
to  equations  (17) . in  this  case 

p(l-Vo)  - qX(e-2)  - l/2 
X2  £(  1 -2/e)p  « q]2  - q. 

Eliminating  p now  there  is  obtained  for  q the  equation 

X2(e  p ♦ p)2  = Y Q (20) 

a ■ 6X( e-2) " > (6-X)e 
y * 3(«~2) 

y-.V*>2. 

Consequently, 

1/2 

q * |(y  “ 2a0X2)  ♦ [y(y  - Uapx2)j  2a2X2.  (21) 

Of  the  two  possible  solutions  indicated  here  the  one  corresponding  to  the 
positive  sign  bo comes  unbounded  as  X approaches  zero.  Since  it  is  desired 
to  keep  the  solutions  for  all  / X/  ±.  Xq  of  norm  not  exceeding  unity  the  positive 
sign  in  eq.  (21)  must  be  discarded. 
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Supoose  we  wish  to  determine  the  solution  of  eq*  (18)  for  >.  <■  0.2 


For  the  initial  approximation  we  take 

p0  - % - 1. 

4 ^ 

yo(x)  - 0.2  (x  + exp  (x))s 
The  resulting  approximations 

• °-2  fVd  * ■ 1/2 

2/ 

V.  " 0eQi*  [(e~^'Pj/a  * %ij 

are  shown  in  the  table  below. 

i'aHis  }. . successive  Approximation 


n 

qn 

0 

1.0000 

1.0000 

1 

0.6770 

0.0639 

2 

n . £ ii  “ 
- » 

/\  AArtl 

3 

0,5131 

0.0008 

h 

o.5m 

0.0008 

The  exact  solution,  as  determined  from  eq.  (21),  is 

y(x)  - 0.2  (0.51735  X 0.00075  exp  (x». 

While  there  is  always  convergence  to  the  solution  for  y € J,  1 Xf  X , 

o o 

the  choice  of  an  initial  approximation  y outside  of  J,  or  a value  of  JXJ>X 

o o 

say  lead  to  divergence.  This  is  the  case,  for  example,  for  P0  “ ^ " 25, 

X « 0.2,  and  p - q - 1,  X - 1,, 

MARK  L0TKIN 
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It  is  worthwhile  mentioning  that  iterative  procedures  such  as  those 
exemplified  by  eqs.  (15)  are  eminently  suited  for  treatment  on  high  speed 
computing  machinery.  The  required  quadratures  may  be  performed  u/  anj 
suitable  standard  methods,  or  by  means  of  the  formulas  outlined  in  DJ 
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